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Abstract 

In this paper we propose an iterative algorithm to find out the spectral radius of non- 
negative tensors. This algorithm is an extension of the smoothing method for finding the 
largest eigenvalue of a nonnegative matrix [12]. For nonnegative irreducible tensors, we 
establish the converges of the algorithm. Finally we report some numerical results and 
conclude this paper with some remarks. 
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1 Introduction 



Eigenvalue problems of high order tensor have become an important topic of study in a new ap- 
plied mathematics branch, numerical multilinear algebra, and they have a wide range of practical 
applications, for more references, see [H [5J [H [TUJ [SJ [5] . In recent years, the largest eigenvalue 
problem for nonnegative tensors has attracted special attention. Chang et al [I] generalized 
the Perron- Frobenius theorem from nonnegative irreducible matrices to nonnegative irreducible 
tensors. Ng et al jl] gave a method to find the largest eigenvalue of a nonnegative irreducible 
tensor. Yang and Yang [TT] defined the spectral radius of a tensor and gave further results for 
the Perron-Frobenius theorem and proved that the spectral radius is the largest eigenvalue of 
any nonnegative tensor and all eigenvalues with the spectral radius as their modulus distribute 
uniformly on the circle. In this paper, we propose a method to find the spectral radius of a 
class of nonnegative tensors. This method is an extension of a method in [12] for calculating the 
spectral radius of a nonnegative matrix . We show that for a nonnegative irreducible tensor, 
the sequence generated by this algorithm converges to the spectral radius. 

This paper is organized as follows: In section 2 we recall some definitions and theorems; 
we give our algorithm in section 3 and lay down the proof of the algorithm in section 4; some 
numerical results are reported in section 5. 

We first add a comment on the notation that is used in the sequel. Vectors are written 
as lowercase letters {x, y, . . .), matrices correspond to italic capitals {A, B, . . .), and tensors are 
written as calligraphic capitals (A, S, • • • ). The entry with row index i and column index j in 
a matrix A, i.e. {A)ij is symbolized by (also ("4)^^...^^ = ai^...i^_j^...j^). The symbol | • 
used on a matrix A(or tensor A) means that — |aij|(or {\A\)i^...ipj^...j^ — \ai-^...i^_j-^...j^\). 

R+{R\+) denotes the cone {x G i?" \x, > {>)0,i = The symbol A > (>,<,<)B 

means that Uij > (>, <, <)bij for every i,j and it is the same for rectangular tensors. 



2 Preliminaries 

First we recall the definition of tensor: a tensor is a multidimensional array, and a real 
order m dimension n tensor A consists of n™ real entries: 

where ij = 1, - ■ ■ ,n for j — 1, ■ ■ ■ ,m. li a number A and a nonzero vector x are solutions of the 
following homogeneous polynomial equations: 

then A is called the eigenvalue of A and x the eigenvector of A associated with A, where Ax™~^ 
and are vectors, whose ith component are 



{Ax \i ^ ^ (^1X2 

(^.[m-l]) 



... "^22 ' ' ' '^i 

[m-l]\ _ 
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respectively. This definition was introduce by Qi [7] where he supposed that A is an order m 
dimension n symmetric tensor and m is even. Independently, Lim @] gave such a definition but 
restricted a; to be a real vector and A to be a real number. Here we use the definition given in 

m- 

The Perron-Frobenius theorem for nonnegative tensors is related to measuring high-order 
connectivity in linked objects and hypergraphs, see (SI Let we recall the Perron-Frobenius 
theorem for nonnegative tensors given in [I]: 

Theorem 2.1 (see theorem 1.3 of fJ]/) If A is a nonnegative tensor of order m dimension n, 
then there exists Aq > and a nonnegative vector 2:0 7^ such that 

-AoxlT^'l. (2.1) 

Theorem 2.2 (see theorem I.4 of jjj) If A is an irreducible nonnegative tensor of order m 
dimension n, then the pair (Ao,a;o) in equation i2. l\l satisfy: 

{!) Xq > is an eigenvalue. 

(2) Xq > 0, i.e. all components of Xq are positive. 

(3) If X is an eigenvalue with nonnegative eigenvector, then X — Xq. Moreover, the nonnegative 
eigenvector is unique up to a multiplicative constant. 

(4) If X is an eigenvalue of A, then \X\ < Xq. 
And the reducibility of tensor is defined as follow: 

Definition 2.1 (Reducibility, see definition 2.1 of fj^) A tensor C = (cj^ • • • Ci,,J of order m 
dimension n is called reducible, if there exists a nonempty proper index subset / C {1, • • • ,n} 
such that 

Cii---j„ =0, Vii e /, Vi2,-- - ,irn ^ I- 

If C is not reducible, then we call C irreducible. In [11], Yang and Yang prove that for any 
nonnegative tensor, the spectral radius is the largest eigenvalue of it, which is an enhancement 
of theorem 12.11 

Theorem 2.3 (See theorem 2.3 of Ulf ) If A is a nonnegative tensor of order m dimension n, 
then p{A) is an eigenvalue with a nonnegative eigenvector y £ i?" corresponding to it. 

Definition 2.2 The spectral radius of tensor A is defined as 

p{A) = max{|A| : X is an eigenvalue of A}. 

For positive tensors, the following theorem holds: 

Theorem 2.4 (See theorem 2.4 of Jllf) Let A be a positive order m dimension n tensor, if X 
is an eigenvalue of A except p{A), then p{A) > \X\. 
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3 Algorithm 



Before presenting our algorithm, we give the definition of diagonal similar tensors, which 
was first used by Yang et al [11] : 

Definition 3.1 (diagonal similar tensors) Let A = {ai-^...i^),B = (bi-^...i^) be two order m 
dimension n tensors, if there is a nonsingular diagonal matrix D — (dij), such that 



where 

On the diagonal similar tensors we have the following proposition: 

Proposition 3.1 Let A,B,D be defined as above, if A,B have eigenvalues, then they have the 
same eigenvalues, i.e, if X be an eigenvalue of A with corresponding eigenvector x ^ 0, then 
A is also an eigenvalue of B with corresponding eigenvector Dx; if p is an eigenvalue of B 
with corresponding eigenvector y ^ Q, then p is also an eigenvalue of A with corresponding 
eigenvector D^^y. 

Proof. 

{B • {^L)X^ )i ^ ^ ^1,12 ■■ -im ^^2 ,*2 ' ' ' ^i?Ti ^^TTi ^^2 ' ' ' 

i2,--- ,im=i 



= Xd'^-^'^'^ = \{Dx)^, I = !,■■■ ,n. 
The proof of AiD-^y)"^-^ piD-^y)^""-^^ is the same. □ 
One easily gets following estimation: 

Lemma 3.1 (See lemma 5.6 of ]TTj) Let A > Q be an order m dimension n tensor. Denote 
p{A) the spectral radius of A. Then 



l<i<n ^ — ^ 



min > 

l<i<n 

Z2,---,im— 1 *2 ■ ■ ^^TTi — 1 



Let Ri = J2i2 ■■■ i„=i ^i,i2 - im- If = C", where C is a constant, we have the following 
proposition: 

Lemma 3.2 (See lemma 5.5 of Ulf ) Suppose A > be an order m dimension n tensor, if 
Ri = 'J2i2 i =1 ^i,i2---im = C{constant) for i — 1, - ■ ■ ,n, then 

p{A) = C. 



4 



Given an order m dimension n nonnegative irreducible tensor B, we calculate its spectral radius 
as follow: 



Algorithm 3.1 step 1. Let A = B + 1. Denote A^^'^ = A, set k :— 0, compute 



R 



(0) 



= max r^o' = min Rf\ 

i/i?(o) = r("), let v{A) = e = (1, ■ • • , 1)'^, goto step 3, else goto step2. 
step 2. Compute 

m — 1 



where 



and 



compute 



^(fc+l) ^ j^{k) . jji^f^y(m-l) .... 

Dik) = diag{{Rl)^,--- ,{R';,)^) 



R 



(fc+i) 



E 



ffc+i) 



= max r(^+i) = min i? 

l<i<n * l<i< 



(fc+1) 



if Rik+i) — ,,(^+1)^ goto gtgp Qisg loop g^gp 2. 

step 3. Output p{B) = R^''^ — 1, v{A) as the eigenvalue and eigenvector of B. 

Remark. When m = 2, this algorithm reduces to the smoothing method in jH], and r\'^'^ is 
the sum of the ith row of matrix A^''\ 

It is easy to notice that A satisfies the following condition: 



(fe+i) 



,R 



(fe+i) 



Condition .1 



Hence algorithm 13.11 is well-defined. Moreover, we have the following theorem to ensure that 

R(k) „ ^(fc) 

is nonincreasing as fc — s> cxd (and in fact we can prove it decreases strictly): 

Theorem 3.1 Under Condition. 1, 

r < r(i) < ■ • • < rC^) < • ■ • < p{A) <■■ < < ■ ■ ■ < R- 



Under the assumption of irreducibility of B, we have 
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Theorem 3.2 IfA = B + I, then 

lim A''^ = lim i?^^) = p{A). 

This theorem shows that the algorithm can find the spectral radius. We will prove these 
theorems in the next section. 



4 Convergence analysis 

In this section, we will prove theorems 13.11 and 13.21 First we give a lemma: 
Lemma 4.1 

where R^^\r'--^^ are defined in alaorithm \8.1\ 

Proof. Without loss of generality we suppose that R^^'> = Ri''\ r^''^ — r[''\ s,t e {1,2, ■■ ■ ,n}. 
We have 



< 



p(fc-i) 
as,»2---i™ (fe-i) 



1) 



1 

*2,'"" ,*m — 1 

r(fc-l) 

Z2,-"" ^*m — 1 

□ 

Proof of theorem I3.lt From lemma I5TT] and HTTl we can easily see that theorem 13.11 holds . 

□ 



The following proposition shows that the sequence {R'^^'> — r^*^) } is decreasing strictly: 

Proposition 4.1 Let A he defined in algorithm \3.1[ i E I = {1, • • • ,n}, and without loss 
of generality suppose that i?*^'^^ — Ri!^\r^''^ — R^^^ ; let J = J(fc) = {{i2,-'- ,im)\ > 

'''„%)"" ]> ^ = {{i2,--- ,im.)\i2,--- ,im G /}. Then we have 
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Proof. We only prove the case when k = 1, i.e. 

i?«-rW<(i?-r)[l-l( «-.-™+ E «M.-..)]- (4.2) 

For fc = 2, 3, • • • the proof is the same. 

If = r(^', then (j4.2p holds easily, so we suppose that R'-^^ > r'^^. 

1 1 1 1 
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By definition of J and R^^^ > r*^^^ we see that J,N ~ J respectively, thus we have 



Rt ~ ~ ^ R's ' 

(i2,---,i™)eJ (i2,---,ir„)eJV-J 



Combining (|4.3p and (|4.4p we have 



< 



(i2,--- ,im)eN-J * 

^ ^^^^ 1^^^' ^ ^^^^ 



I2---«IT 



= E — E — R— ) 

= (i?-r)[l-( 5: Y: ^^)] 



{i2,--- ,im)&N-J (i2,--- ,i,n)e J 

The proof is completed. □ 



From Proposition 14.11 we see that {i?^^) - rC^)} is a nonnegative and strictly monotone 
decreasing sequence, so it has limit, but it is not sufficient to show theorem 13.21 Before prove 
it, we denote M-^*^^ — (riiLo ~ • • • , n, hence v^'^\A) defined in algorithm 13.11 is 

{m[''\- ■ ■ , Mi''^)'^ and V^''\A) the matrix representation of v^'^^A), i.e: 

V(''\A) ^dtag{M[''\--- ,mW). 

Note that the limit of M^'"' = (HILo ik)^ exists. Denote it by Af *, i = 1, • • • , n, and v*{A), 
V*{A) the limit oiv'-'^^A), V'^'^^A), respectively. We introduce a notation: 

rn — 1 

ViA)"'-'^ ■ A ■ ■'v{A)--''---ViA) 
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m — 1 



= A-I-V{A) V{A). 

Where the superscript '(A;)' is ignored. Then we have 



A-I-V'^''\A) V^''\A) -e™-^ 



Letting A: ^ cxd we have 

Av*{Ar-^ >r*v*iA)^'''-^l (4.5) 
By theorem 13. 11 r* exists, where r* is the hmit of r^'"', and it satisfies the proposition: 

Proposition 4.2 r* > r^^^ , fc = 1, 2, • • • . 

If (|4.5p is an equation, by theorem 12. 2[ r* is the spectral radius. Suppose not, denote 

xo{v*{A)) = {Av*{Ar-^i^\ 
y^{v*{A)) = {r*v*{At^-'^i^^; 
x^{v*{A)) = {Ax^-'i^\ 
yiK(^)) = (^y™-i)[^l; 



y(„^i)(«*(^)) = (^2/[:::^))[^l. 



We wiU prove 



>y(„_i)(«*(^)) (4.6) 

. Recall theorem 6.6 given in [TT| : 

Theorem 4.1 ('see theorem 6.6 of JTTI) Let B >0 be an order m dimension n tensor. Then B 
is irreducible if and only if for all x £ i?" , x ^ 0, let xq — x and xi~+i = {B + I)a;™^^. Then 
Xn-l > 0. 

We follow this theorem to prove a lemma: 

Lemma 4.2 Let B be defined as above. Denote A = B + 1. Suppose x,y £ i?" and x >y. let 

xo ^ x,ya = y and Xk+i = At™"\ yk+i = ^2/™"^ Then a;(„_i) > ?/(„_i). 
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Proof. It is easy to see that > y^n-i)- Let I^. = {i\xk. = 1/^.} and = so 

does Mk+i- All we need to do is to prove that M^+i < Mf^. First we consider Xk+ii — 
{Ax"^"^ +2^1™ where i ^ h- We have xu+i, > Uk+ii because {Ax'^~^)i > iAy]^~^)i and 
Xki > Vk,- For all i G h, Xk+u = Z]i2,-- ,i„=i <^"2-i„a;fc.2 We claim that at least a 

Xfc+i, > Uk+u, i e 4- Suppose not, then J2i2,--- .i^=i aii2-im{^k,^ ■ ' -a^fei^ - Uki^ ■ ■■Vk,^) = 0, 
i e Ik- It means that au^.-.t^^ = 0, 12, ■ • • , *m ^ Ik and z e /jt, which contradicts to the 
irreducibility of A. Thus at least a Xk+i^ > J/fc+ii, « G ^fc, which means that Mk+i < Mk- 
Repeat at most n — 1 times, we have Xn-i > Vn-i- D 

It is easy to see that this lemma holds when we replace Xk+i = Ax^"^ , Vk+i — Ay^~^ by 
Xk+i = {Ax™~^)^^^\ Uk+i = By this lemma, if (|431) is not an equation, then 

(|4.6p holds. By the continuity of a;(„_i)(-) — J/(ri-i)(Oi when k sufficiently large, one has 

X(„_i)(w^-(-4)) > (4.7) 



and 



xo{v''{A)) - (^«('=)(^)"'-i)[^l = (i?('=+i))^w('=+i)(^), 
xi(i;'=(^)) = (i?('=+i)i?('=+2))^«('=+2)(^), 



a;(„_i)(i;'=(^)) = (J] i?''+'))^«*'+"H^), 

n-l 

y(„_i)(«'=(^)) = r*(n i?(^+'))^«('=+"-^)(^). 



1=1 



Then (liJl) means that 



it- ' > r , I = 1, • • • , n, 

especially r'^'^+") > r* when k sufficiently large, which contradicts with proposition |4?2l Thus 

Av^Ay^-^ =r*w*(^)["-il. 

The same proof can apply to Av*{A)"'-'^ = R*v* {A)^"'-'^l Hence theorem [Sj holds and v*{A) 
is the positive corresponding eigenvector of p{A) . 



5 Numerical results 

In this section, we first give numerical result on a 3-order 3-dimension nonnegative ir- 
reducible tensor; then we generate some random tensors to test our algorithm. We use the 
termination condition given in [5]: 

(1) k > 100, 

(2) i?W -rW < 10(-^). 

Example 1. Consider the 3-order 3-dimensional tensor 

B= [i?(l,:,:),i?(2, :,:),i?(3, :,:)], 

where 

5(1,:,:) = 
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B{2, 



B{3, 



( 9.02 




/ 9.55 


V 



Example 2. We use some randomly generated tensors to test algorithm 13.11 Each entry of 
these tensors is between and 10. 

Table 1 is the numerical results of algorithm [XT] for example 1 where the tensor is ^ = 
From the result, we get p(B) — 6.79262 — 1 = 5.79262 and the positive corresponding eigen- 
vector is (0.46224,0.57681,0.593515)^. But if we directly apply the algorithm to i3, it does not 
converges. Table 2 shows some numerical results on randomly generated tensors of different 
order and dimension. In our experiment, the algorithm converges to the spectral radius for all 
the tensors although there may be some reducible tensors in these randomly generated tensors. 



Table 1: numerical results of algorithm 13. II for example 1 



k 








0.5* +r('=)) 


1 


4.72 


10.55 


5.83 


7.635 


2 


5.24894 


8.89712 


3.64818 


7.07303 


3 


5.65898 


8.2097 


2.55071 


6.93434 


4 


5.96904 


7.7527 


1.78366 


6.86087 


5 


6.19911 


7.45402 


1.25491 


6.82656 


6 


6.36745 


7.25147 


0.88402 


6.80946 


48 


6.79262 


6.79262 


3.83995e-007 


6.79262 


49 


6.79262 


6.79262 


2.70932e-007 


6.79262 


50 


6.79262 


6.79262 


1.9116e-007 


6.79262 


51 


6.79262 


6.79262 


1.34875e-007 


6.79262 


52 


6.79262 


6.79262 


9.51629e-008 


6.79262 



6 Conclusion and remarks 



We give an algorithm to find the spectral radius of nonnegative tensors. When the tensor 
is irreducible, our algorithm can assure to find out the spectral radius and its corresponding 
positive eigenvector. This result is better than the algorithm proposed by Michael tt al [6|. We 
can also apply algorithm 13. II to A(a) — B ^ aT where a is a positive number. The choice of a 
will affect the convergence rate of the algorithm. This needs further research. 
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Table 2: 


numerical results of al 


gorithm 13.11 for 


sonic randomly generated tensors 




k 


p(^) 




W^uy^j fjy^juy^j \\oo 




7 


444.247 


9 56E-09 


5 21E-nQ 




8 


111.111 


2 56R-08 


1 52E-n8 


(in 


6 


1791.51 


2 1 5R-08 


q 03E-nq 




6 


4057.86 


1 34R-09 


6 32E-in 

. (J 1 1 1-\J 




5 


11225.7 


3 6nR-08 


1 81E-n8 


noo 3") 

\ V7 • !j J 


5 


45013 


2 57E-09 


1 21E-09 

A^ * ^ A- A-J yj \J 




6 


35983.8 


2 28E-1 1 


6 85E-n 




7 


556.015 


2.44E-10 


1.58E-10 


ClO 4~) 


6 


4494.69 


1 92E-10 


1.04E-10 


C15 4") 


6 


15144 


1.78E-11 


2 38E-1 1 


csn 4") 


5 


121554 


1 02E-10 


1.75E-10 




5 


2765.93 


1 83E-08 


9 43E-09 


(10 5) 


5 


44913.9 


7.23E-10 


7.02E-10 


(15,5) 


4 


227923 


7.56E-09 


6.42E-09 


(20,5) 


4 


720407 


2.95E-08 


4.01E-08 


(5,6) 


4 


14091.6 


2.69E-08 


l.llE-08 


(10,6) 


4 


450133 


1.27E-08 


2.16E-08 


(15,6) 


4 


3.42E+06 


5.09E-08 


4.03E-07 
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